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This  study  responds  to  your  request  that  we  comprehensively  evaluate  the 
use  and  effectiveness  of  the  various  aircraft,  munitions,  and  other  weapon 
systems  used  in  the  victorious  air  campaign  in  Operation  Desert  Storm  in 
order  to  aid  the  Congress  in  future  procurement  decisions. 

Over  5  years  ago,  the  United  States  and  its  coalition  allies  successfully 
forced  Iraq  out  of  Kuwait.  The  performance  of  aircraft  and  their  munitions, 
cruise  missiles,  and  other  air  campaign  systems  in  Desert  Storm  continues 
to  be  relevant  today  as  the  basis  for  significant  procurement  and  force 
sizing  decisions.  For  example,  the  Department  of  Defense  (dod)  Report  on 
the  Bottom-Up  Review  (bur)  exphcitly  cited  the  effectiveness  of  advanced 
weapons  used  in  Desert  Storm — ^including  laser-guided  bombs  (lgbs)  and 
stealth  aircraft— as  shaping  the  bur  recommendations  on  we^ons 
procurement.^ 

This  report  is  an  unclassified  summary  of  our  classified  report.  The  table 
of  contents  for  that  report  is  included  in  sqipendix  I  to  provide  an  outline 
of  the  breadth  of  our  evaluation. 


Background 


Operation  Desert  Storm  was  primarily  a  sustained  43-day  air  campaign  by 
the  United  States  and  its  allies  against  Iraq  between  January  17, 1991,  and 
February  28, 1991.  It  was  the  first  large  employment  of  U.S.  air  power 
since  the  Vietnam  war,  and  by  some  measures  (particularly  the  low 
number  of  U.S.  casualties  and  the  short  duration  of  the  campaign),  it  was 
perhaps  the  most  successful  war  fought  by  the  United  States  in  the  20th 
century.  The  main  ground  campaign  occupied  only  the  final  100  hours  of 
the  war. 


'Department  of  Defense,  Report  on  the  Bottom-Up  Review  (Washington,  D.C.:  October  1993),  p.  18. 
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The  air  campaign  involved  nearly  every  type  of  fixed-wing  aircraft  in  the 
U.S.  inventory,  flying  about  40,000  air-to-ground  and  50,000  support 
sorties.2  Approximately  1,600  U.S.  combat  aircraft  were  deployed  by  the 
end  of  the  war.  By  historical  standards,  the  intensity  of  the  air  campaign 
was  substantial.  The  U.S.  bomb  tormage  dropped  per  day  was  equivalent 
to  85  percent  of  the  average  daily  bomb  tonnage  dropped  by  the  United 
States  on  Germany  and  Japan  during  the  course  of  World  War  n. 

Operation  Desert  Storm  provided  a  valuable  opportunity  to  assess  the 
performance  of  U.S.  combat  aircraft  and  munitions  systems  under  actual 
combat  conditions.  Unlike  operational  tests  or  small-scale  hostilities,  the 
air  campaign  involved  a  very  large  number  of  conventional  systems  from 
aU  four  services  used  in  tandem,  which  permits  potentially  meaningful 
cross-system  comparisons.  The  combat  data  in  this  report  can  be  seen  as 
an  extension  of  the  performance  data  generated  by  dod’s  operational  test 
and  evaluation  programs  that  we  have  previously  reviewed.^ 


Objectives 


To  respond  to  your  questions  about  the  effectiveness  of  the  air  campaign; 
the  performance  of  individual  weapon  systems;  the  accuracy  of  contractor 
claims,  particularly  in  regard  to  stealth  technology  and  the  F-117;  and  the 
relationship  between  the  cost  of  weapon  systems  and  their  performance 
and  contributions  to  the  success  of  the  air  campaign,  we  established  the 
following  report  objectives. 

1.  Determine  the  use,  performance,  and  effectiveness  of  individual  weapon 
systems  in  pursuit  of  Desert  Storm’s  objectives,  and  in  particular,  the 
extent  to  which  the  data  from  the  conflict  support  the  claims  that  dod  and 
weapon  contractors  have  made  about  weapon  system  performance. 

2.  Describe  the  relationship  between  cost  and  performance  for  the  weapon 
systems  employed. 

3.  Identify  the  degree  to  which  the  goals  of  Desert  Storm  were  achieved  by 
air  power. 


^Support  sorties  comprised  missions  such  as  refueling,  electronic  jamming,  and  combat  air  patrol. 

®See  U.S.  General  Accounting  Office,  Weapons  Acquisition:  Low-Rate  Initial  Production  Used  to  Buy 
Weapon  Systems  Prematurely.  GAO/NSIAD-95-18  (Washington,  D.C.:  November  1994);  Weapons 
Acquisition:  A  Rare  Opportunity  for  Lasting  Change,  GAO/NSIAD-93-16  (Washington,  D.C.:  December 
1992);  Weapons  Testing:  Quality  of  DOD  Operational  Testing  and  Reporting,  GAO/PEMD-88-32BR 
(Washington,  D.C.:  July  1988);  Live  Fire  Testing:  Evaluating  DOD^s  Programs,  GAO/PEMD-87-17 
(Washington,  D.C.:  August  1987);  and  How  Well  Do  the  Military  Services  Perform  Jointly  in  Combat? 
POP’s  Joint  Test  and  Evaluation  Program  Provides  Few  Credible  Answers,  GAO/PEMD-84r3 
(Washington,  D.C.:  February  1984).  “ 
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4.  Identify  the  key  factors  aiding  or  inhibiting  the  effectiveness  of  air 
power. 

5.  Identify  the  contributions  and  limitations  of  advanced  technologies  to 
the  accomplishments  of  the  air  campaign. 

6.  Determine  whether  the  unique  conditions  of  Desert  Storm  linut  the 
lessons  learned. 


Summary 


Operation  Desert  Storm  was  a  highly  successful  and  decisive  military 
operation.  The  air  campaign,  which  incurred  minimal  casualties  while 
effecting  the  collapse  of  the  Iraqis’  ability  to  resist,  helped  liberate  Kuwait 
and  elicit  Iraqi  compliance  with  U.N.  resolutions.  However,  our  analysis  of 
the  air  campaign  against  strategic  targets  revealed  several  air  power  issues 
that  require  attention  before  the  next  campaign.  First,  the  effectiveness  of 
air  power  in  Desert  Storm  was  inhibited  by  the  aircraft  sensors’  inherent 
limitations  in  identifying  and  acquiring  targets  and  by  dod’s  failure  to 
gather  intelligence  on  the  existence  or  location  of  certain  critical  targets 
and  its  inability  to  collect  and  disseminate  timely  battle  dame^e 
assessments  (bda).  Pilots  noted  that  infrared,  electro-optical,  and  laser 
systems  were  all  seriously  degraded  by  clouds,  rain,  fog,  smoke,  and  even 
high  humidity,  and  the  pilots  reported  being  unable  to  discern  whether  a 
presumed  target  was  a  tank  or  a  truck  and  whether  it  had  already  been 
destroyed.  The  failure  of  intelligence  to  identify  certain  targets  precluded 
any  opportunity  for  the  coalition  to  fuUy  accomplish  some  of  its 
objectives.  And  the  reduced  accuracies  from  medium  and  high  altitudes 
and  absence  of  timely  bda  led  to  higher  costs,  reduced  effectiveness,  and 
increased  risks  from  making  unnecessary  restrikes. 

Second,  U.S.  commanders  were  able  to  favor  medium-  to  high-altitude 
strike  tactics  that  maximized  aircraft  and  pilot  survivability,  rather  than 
we£^)on  system  effectiveness.  This  was  because  of  early  and  complete  air 
superiority,  a  limited  enemy  re^onse,  and  terrain  and  climate  conditions 
generally  conducive  to  air  strikes.  Low-altitude  munitions  deliveries  had 
been  emphasized  in  prewar  training,  but  they  were  abandoned  early.  'The 
subsequent  deliveries  from  medium  and  high  altitudes  resulted  in  the  use 
of  sensors  and  weapon  systems  at  distances  from  targets  that  were  not 
optimal  for  their  identification,  acquisition,  or  accuracy.  Medium-  and 
high-altitude  tactics  also  increased  the  exposure  of  aircraft  sensors  to 
man-made  and  natural  impediments  to  visibility. 
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Third,  the  success  of  the  sustained  air  campaign  resulted  from  the 
availability  of  a  mix  of  strike  and  support  assets.  Its  substantial  weight  of 
effort  was  made  possible,  in  significant  part,  by  the  variety  and  number  of 
air-to-ground  aircraft  types  from  high-payload  bombers,  such  as  the  B-52, 
to  platforms  capable  of  delivering  guided  munitions  such  as  the  stealthy 
F-117,  to  high-sortie-rate  attack  aircraft  such  as  the  A-10.  A  range  of  target 
types,  threat  conditions,  and  tactical  and  strategic  objectives  was  best 
confronted  with  a  mix  of  weapon  systems  and  strike  and  support  assets 
with  a  range  of  capabilities. 

Fourth,  despite  often  sharp  contrasts  in  the  unit  cost  of  aircraft  platforms, 
it  is  inappropriate,  ^ven  aircraft  use,  performance,  and  effectiveness 
demonstrated  in  Desert  Storm,  to  characterize  higher  cost  aircraft  as 
generally  more  citable  than  lower  cost  aircraft.  In  some  cases,  the  higher 
cost  systems  had  the  greater  operating  limitations;  in  some  other  cases, 
the  lower  cost  aircraft  had  the  same  general  limitations  but  performed  at 
least  as  well;  and  in  stUl  other  cases,  the  data  did  not  permit  a 
differentiation. 

Fifth,  “one-target,  one-bomb”  efficiency  was  not  achieved.  The  air 
campaign  data  did  not  validate  the  purported  efficiency  or  effectiveness  of 
guided  munitions,  without  qualification.  On  average,  more  than  11  tons  of 
guided  and  44  tons  of  unguided  munitions  were  delivered  on  targets 
assessed  as  successfully  destroyed;  still  more  tonnage  of  both  was 
delivered  against  targets  where  objectives  were  not  fully  met.  Large 
tonnages  of  munitions  were  used  against  targets  not  only  because  of 
inaccuracy  from  high  altitudes  but  also  because  bda  data  were  lacking. 
Although  the  relative  contribution  of  guided  munitions  in  achieving  target 
success  is  unknowable,  they  did  account  for  the  bulk  of  munitions  costs. 
Only  8  percent  of  the  delivered  munitions  tonnage  was  guided,  but  at  a 
price  that  represented  84  percent  of  the  total  munitions  cost.  During 
Desert  Storm,  the  ratio  of  guided-to-unguided  munitions  delivered  did  not 
vary,  indicating  that  the  relative  preferences  among  these  types  of 
munitions  did  not  change  over  the  course  of  the  campaign.  More  generally. 
Desert  Storm  demonstrated  that  many  systems  incorporating  complex  or 
advanced  technologies  require  specific  operating  conditions  to  operate 
effectively.  These  conditions,  however,  were  not  consistently  encountered 
in  Desert  Storm  and  cannot  be  assumed  in  future  contingencies. 

Lastly,  many  of  dod’s  and  manufacturers’  postwar  claims  about  weapon 
system  performance — ^particularly  the  F-117,  tlam,  and  laser-guided 
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bombs — ^were  overstated,  misleading,  inconsistent  with  the  best  available 
data,  or  unverifiable. 


Scope  and 
Methodology 


In  this  report,  we  evaluate  the  aircraft  and  munitions  that  we  deemed  to 
have  had  a  major  role  in  the  execution  of  the  Desert  Storm  air  campaign 
by  virtue  of  their  satisfying  at  least  one  (in  most  cases,  two)  of  the 
following  criteria  The  system 

•  played  a  major  role  against  strategic  targets  (broaxUy  defined), 

•  was  the  focus  of  congressional  interest, 

•  may  be  considered  by  dod  for  future  major  procurement, 

•  appeared  likely  to  play  a  role  in  future  conflicts,  or 

.  even  if  not  slated  currently  for  major  procurement,  either  was  used  by 
allied  forces  in  a  manner  or  role  different  from  its  U.S.  use  or  used  new 
technologies  hkely  to  be  employed  in  the  future. 

These  criteria  led  us  to  assess  the  A-6E,  A-10,  B-62,  F-lllF,  F-117A,  F-15E, 
F-16,  F/A-18,  and  British  Tornado  (GR-1).^  We  examined  both  guided  and 
unguided  munitions,  including  laser-guided  bombs.  Maverick  missiles. 
Tomahawk  land-attack  (cruise)  missiles  (tlams),  and  unguided  “dumb” 
bombs. 

We  assess  the  effectiveness  of  various  U.S.  and  allied  air  campaign  aircraft 
and  weapon  systems  in  destroying  ground  targets,  primarily  those  that  fall 
into  the  category  of  “strategic”  targets.®  We  focused  our  analysis  on 
strategic  targets  in  part  because  they  received  the  best  documented  bda, 
although  there  was  substantial  variation  from  target  to  target  and  among 


■•The  AV-8B,  A-7,  and  B-IB  were  not  included.  Both  the  AV-8B  and  the  A-7  were  excluded  because  of 
their  relatively  few  strikes  against  strategic  targets.  The  B-IB  did  not  participate  in  the  r^paign 
because  munitions  limitations,  engine  problems,  inadequate  crew  training,  and  electronic  warfare 
deficiencies  severely  hampered  its  conventional  capabilities. 

^In  Operation  Desert  Storm,  some  targets  were  clearly  strate^c,  such  as  Iraqi  Air  Force  headquarters 
in  Baghdad,  while  others,  essentially  the  Iraqi  ground  forces  in  the  Kuwait  theater  of  operations,  could 
be  considered  both  strategic  and  tactical.  For  our  purposes,  we  concentrated  on  the  effects  achieved 
by  the  air  campaign  before  the  start  of  the  ground  offensive,  including  successes  against  ground  forces 
in  Kuwait.  Unlike  most  previous  large-scale  conflicts,  the  air  campaign  accounted  for  more  than 
90  percent  of  the  entire  conflict's  duration.  Therefore,  what  we  have  excluded  froni  our  analysis  is  the 
role  of  air  power  in  supporting  ground  forces  during  the  ground  offensive  (“close  air  support  ),  as  well 
as  such  nonstrategic  missions  as  search  and  rescue. 
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Methodology 
Data  Sources 


target  types  in  the  quantity  and  quaJily  of  bda.  The  12  categories  of 
strategic  targets  in  Desert  Storm  are  listed  in  appendix  II. 

Historically,  studies  of  air  power  have  articulated  differing  points  of  view 
on  the  relative  merits  of  focusing  air  attacks  on  targets  deemed  to  be 
strategic  (such  as  government  leadership,  militaiy  industry,  and  electrical 
generation)  and  focusing  them  on  tactical  targets  (such  as  frontline  armor 
and  artillery).  These  contending  points  of  view  have  been  debated  in  many 
official  and  unofficial  sources.®  In  this  study,  we  did  not  directly  address 
this  debate  because  data  and  other  limitations  (discussed  below)  did  not 
permit  a  rigorous  analysis  of  whether  attacks  against  strategic  targets 
contributed  more  to  the  success  of  Desert  Storm  than  attacks  against 
tactical  targets. 


A  primary  goal  of  our  work  was  to  cross-validate  the  best  available  data  on 
aircraft  and  we^on  system  performance,  both  qualitative  and 
quantitative,  to  test  for  consistency,  accuracy,  and  reliability.  The  data  we 
analyzed  in  this  report  are  the  best  information  collected  dming  the  war. 
They  were  compiled  for  and  used  by  the  commanders  who  managed  the 
air  campaign.  These  data  also  provided  the  basis  for  postwar  dod  and 
manufacturer  assessments  of  aircraft  and  weapon  system  performance 
during  Desert  Storm.  We  balanced  the  limitations  of  the  data,  to  the  extent 
possible,  against  qualitative  analyses  of  the  systems.  For  example,  we 
compared  claims  made  for  system  performance  and  contributions  to  what 
was  supportable  given  all  the  available  data,  both  quantitative  and 
qualitative. 

We  collected  and  analyzed  data  from  a  broad  range  of  sources,  including 
the  m£gor  dod  databases  that  document  the  strike  histories  of  the  war  and 
cumulative  damage  to  targets;  numerous  after-action  and  lessons-leamed 
reports  from  military  units  that  participated  in  the  war;  intelligence 
reports;  analyses  performed  by  dod  contractors;  historical  accounts  of  the 
war  from  the  media  and  other  published  literature;  and  interviews  with 
participants,  including  more  than  100  Desert  Storm  pilots  and  key 


^Examples  include:  Edward  C.  Mann,  III,  Thunder  and  Lightning  (Maxwell  Air  Force  Base,  Ala.:  Air 
University  Press,  April  1995);  John  A  Warden,  HI,  The  Air  Campaign  (Washington,  D.C.: 
Pergarnon-Brapey’s,  1989);  and  Richard  T.  Reynolds,  Heart  of  the  Stonn:  The  Genesis  of  the  Air 
Campaign  Against  Iraq  (Maxwell  Air  Force  Base,  Ala.:  Air  University  Press,  April  1995). 
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Data  Analysis 


individuals  in  the  planning  and  execution  of  the  war/  We  also  interviewed 
key  Desert  Storm  planners  and  analysts  from  a  wide  spectrum  of 
organizations,  both  within  and  outside  DOD.  (See  appendix  III.) 

After  we  collected  and  analyzed  the  air  campaign  information,  we 
interviewed  dod.  Joint  Chiefs  of  Staff,  and  service  representatives  and 
reviewed  plans  for  the  acquisition  and  use  of  weapon  systems  in  future 
campaigns  to  observe  how  the  lessons  learned  from  Desert  Storm  have 
been  applied.  Our  analyses  were  also  reviewed  by  several  experts  on 
either  air  power  issues  in  general  or  the  conduct  of  Operation  Desert 
Storm  in  particular.  (See  appendix  IV.) 

To  compare  the  nature  and  m^nitude  of  the  power  that  Operation  Desert 
Storm  employed  against  strategic  targets  to  the  nature  of  outcomes,  we 
analyzed  two  databases— the  “Missions"  database  generated  by  the  Air 
Force’s  Gulf  War  Air  Power  Survey  (gwaps)  research  group  (to  assess 
inputs)  and  the  Defense  Intelligence  Agency’s  (dia’s)  phase  HI  battle 
damage  assessment  reports  (to  assess  outcomes).  The  Missions  database 
represents  a  strike  history  of  air-to-ground  platforms  and  ordnance  in  the 
Persian  Gulf  war.®  There  are  data  on  862  targets,  with  basic  encyclopedia 
(or  be)  numbers,  that  together  comprise  more  than  1  mMon  pieces  of 
strike  information.  The  phase  III  reports  provided  the  best  cumulative 
all-source  functional  bda  for  each  strategic  target  available  to  planners 
during  the  course  of  the  war. 

To  determine  the  use  of  aircraft  and  munitions  in  achieving  air  campaign 
objectives,  we  used  the  Missions  database  to  determine  weight-of-effort 


^We  did  not  select  pilots  randomly,  given  constraints  on  their  availability,  travel,  and  time.  The  only 
reQuirement  was  that  a  pilot  had  flown  the  relevant  type  of  aircraft  in  a  Desert  Storm  combat  mission. 
In  most  cases,  the  pilots  had  flown  numerous  missions.  The  purpose  of  interviewing  pilots  was  to 
receive  as  direct  input  as  possible  from  the  aircraft  and  munition  user  rather  than  views  filtered 
through  official  reports.  In  U.S.  General  Accounting  Office,  Operation  Desert  Storm:  Limits  on  the  Role 
and  Performance  of  B-52  Bombers  in  Conventional  Conflicts,  GAO/NSIAD-93-138  (Washington,  D.C.: 
May  1993),  we  assessed  the  B-52  role  in  detail.  Where  they  were  relevant,  we  incorporated  the  data  and 
findings  from  that  report  into  our  comparisons.  The  British  government  denied  our  requests  to 
interview  British  pilots  who  had  flown  in  Desert  Storm.  However,  we  were  able  to  obtain  some  official 
assessments  of  the  British  role  in  the  air  campaign,  and  we  interviewed  U.S.  pilots  about  their 
interactions  with  British  pilots. 

®GWAPS  researchers  compiled  a  very  large  computerized  database  on  aerial  operations  in  the  Persian 
Gulf  war  from  existing  records.  It  documents  aircraft  strikes  on  ground  targets,  number  and  tjqje  of 
ordnance,  date,  and  time  on  target  information,  target  names  and  identifiers,  desired  mean  point  of 
impact,  and  additional  mission-related  information.  It  contains  strike  history  information  across  the 
duration  of  the  air  campaign  for  most  of  the  air-to-ground  platforms  that  participated. 
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Study  Strengths  and  Limitations 


(woe)  and  type-of-effort  measures  (toe)  at  two  levels.^  First,  we  calculated 
WOE  and  toe  at  the  broad  level  of  the  target  category  for  each  of  the  12 
strategic  target  categories  shown  in  appendix  11.  Second,  we  calculated 
woe  and  toe  for  each  aircraft  and  tlam  across  the  12  categories. 

We  used  phase  HI  reports  on  fixed  strategic  targets  to  determine  the 
extent  to  which  the  functional  capabilities  of  the  target  had  been 
eliminated.  To  correlate  outcomes  on  targets  with  the  input  to  them,  we 
matched  phase  III  data  with  data  in  the  Missions  database.  For  strategic 
targets  where  both  bda  and  woe/toe  data  existed,  we  sought  to  assess  the 
relationship  between  the  woe  and  toe  data  representing  campaign  inputs 
with  phase  HI  bda  data  representing  campaign  outcomes,  at  the  target 
level.  While  this  methodology  has  limitations,  no  other  study  of  Desert 
Storm  has  produced  the  target-specific  input-outcome  database  that  can 
be  derived  from  merging  these  sources. 

This  analysis  of  the  campaign  and  aircraft  and  munitions  use  and 
effectiveness  benefited  from  our  use  of  the  most  comprehensive  strike  and 
BDA  data  produced  from  the  Persian  Gulf  war,  a  previously  untried 
methodology  to  match  inputs  and  outputs  on  targets;  additional  qualitative 
and  quantitative  data  obtained  from  Desert  Storm  veterans  and 
after-action  reports  to  corroborate  information  in  the  primary  databases; 
and  our  utilization  of  the  results  of  other  Desert  Storm  analyses,  such  as 
the  Gulf  War  Air  Power  Survey. 

This  study  is  the  first  to  match  available  Desert  Storm  strike  and  bda  data 
by  target  and  to  attempt  to  assess  the  effectiveness  of  multiple  weapon 
systems  across  target  categories.  Despite  the  data  limitations  discussed 
below,  our  methodology  provided  systematic  information  on  how  weapon 
systems  were  employed,  what  level  and  types  of  weapons  were  required  to 
achieve  success,  and  the  relative  cost-effectiveness  of  multiple  platforms. 
The  reliability  and  validity  of  these  findings  are  strengthened  by  our  use  of 
interviews,  after-action  reports,  and  other  Desert  Storm  analyses  to  better 


^Variables  that  comprise  the  WOE  measure  include  (1)  the  quantity  of  BE  numbers  to  which  platforms 
were  tasked,  (2)  the  quantity  of  strikes  that  platforms  conducted,  (3)  the  quantity  of  bombs  that 
platforms  delivered,  and  (4)  the  quantity  of  bomb  tonnage  that  platforms  delivered.  Variables  that 
comprise  the  TOE  measure  include  (1)  the  quantity  of  bombs  that  were  guided  bombs,  (2)  the  quantity 
of  bombs  that  were  unguided  bombs,  (3)  the  quantity  of  bomb  tonnage  that  was  guided,  and  (4)  the 
quantity  of  bomb  tonnage  that  was  unguided. 

^®This  methodology  was  discussed  with  DIA  analysts  who  were  familiar  with  both  the  Missions 
database  and  the  phase  ID  reports.  They  identified  no  reason  why  this  methodology  would  not  result  in 
valid  comparisons  of  inputs  and  outcomes.  In  addition,  they  believed  that  the  utilization  of  WOE  and 
TOE  variables  would  alleviate  data  problems  previously  encountered  by  analysts  conducting  strike 
BDA. 
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understand  platform  performance  variables  and  place  the  results  of  our 
effectiveness  analyses  in  the  expropriate  context. 

Our  analyses  of  campaign  inputs  (from  the  Missions  database)  and 
outcomes  (from  the  phase  Ill  reports)  against  ground  targets  have 
limitations  of  both  scope  and  reliability  imposed  by  constraints  in  the 
primary  Desert  Storm  databases.  Systematically  correlating  munition 
inputs  against  targets  to  outcomes  was  made  highly  problematic  by  the 
fact  that  the  phase  IE  bda  reports  did  not  provide  a  comprehensive 
compilation  of  bda  for  all  strategic  targets  and  could  not  differentiate  the 
effects  of  one  system  from  another  on  the  same  tai^et.^^ 

We  sought  to  work  around  data  limitations  through  qualitative  analysis  of 
systems,  based  on  diverse  sources.  Claims  made  for  i^stem  performance 
were  assessed  in  light  of  the  most  rigorous  evaluation  that  could  be  made 
with  the  available  data.  We  have  explicitly  noted  data  insufficiencies  and 
uncertainties.  Overall,  data  gaps  and  inconsistencies  made  an 
across-the-board  cost-effectiveness  evaluation  difficult.  However,  there 
were  sufficient  data  either  to  assess  all  the  mqjor  claims  made  by  DOD  for 
the  performance  of  the  major  systems  studied  or  to  indicate  where  the 
data  are  lacking  to  support  certain  claims. 

We  conducted  our  work  between  July  1992  and  December  1995  in 
accordance  with  generally  accepted  government  auditing  standards. 


Conclusions 


We  reached  the  following  conclusions  from  our  review  of  the  air 
campaign: 

dod’s  future  ability  to  conduct  an  efficient,  effective,  and  comprehensive 
air  campaign  will  depend  partly  on  its  ability  to  enhance  sensor 
capabilities,  particularly  at  medium  altitudes  and  in  adverse  weather,  in 
order  to  identify  valid  targets  and  collect,  analyze,  and  disseminate  timely 
BDA. 

A  key  parameter  in  future  weapon  systems  design,  operational  testing  and 
evaluation,  training,  and  doctrine  will  be  pilot  and  aircraft  survivability. 
The  scheduled  retirement  of  strike  and  attack  aircraft  such  as  the  A-6E, 
F-lllF,  and  most  A-lOs  will  make  Desert  Storm’s  variety  and  number  of 
aircraft  unavailable  by  the  year  2000. 


^^Such  assessments,  system  by  system,  were  not  the  objective  of  these  reports.  Since  togets  were 
generally  assessed  only  episodically  and,  in  most  cases,  after  being  hit  by  numerous  diverse  aircraft 
and  munitions  over  a  period  of  time,  it  was  impossible  to  know  which  munition  from  which  aircraft 
had  caused  what  amount  of  damage. 
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•  The  cost  of  guided  munitions  (now  estimated  to  be  over  $58  billion),  their 
intelligence  requirements,  and  the  limitations  on  their  effectiveness 
demonstrated  in  Desert  Storm  need  to  be  considered  by  dod  and  the 
services  as  they  determine  the  optimal  future  mix  of  guided  and  unguided 
munitions. 

DOD  and  associated  agencies  have  undertaken  initiatives  since  the  war  to 
address  many,  but  not  all,  of  the  limitations  of  the  air  campaign  that  we 
identified  in  our  summary  (see  pp.  34)  and  conclusions.  We  have  not 
analyzed  each  of  these  initiatives  in  this  report;  however,  we  briefly 
describe  those  that  apply  to  one  or  more  of  our  conclusions  below. 

First,  DOD  officials  told  us  that  the  most  sophisticated  targeting  sensors 
used  in  Desert  Storm  (which  were  available  only  in  limited  quantities) 
have  now  been  deployed  on  many  more  fighter  aircraft,  thereby  giving 
them  a  capability  to  deliver  guided  munitions.  However,  the  same 
limitations  exhibited  by  these  advanced  sensor  and  targeting  systems  in 
Desert  Storm — ^limited  fields-of-view,  insufficient  resolution  for  target 
discrimination  at  medium  altitudes,  vulnerabilities  to  adverse  weather,  and 
limited  traverse  movement — ^remain  today. 

Second,  dod  officials  told  us  that  to  address  the  Desert  Storm  bda  analysis 
and  dissemination  shortcomings,  they  have  created  an  organization  to 
work  out  issues,  consolidate  national  reporting,  and  provide  leadership; 
developed  DOD-wide  doctrine,  tactics,  techniques,  and  procedures; 
established  more  rigorous  and  realistic  bda  training  and  realistic  exercises; 
and  developed  and  deployed  better  means  to  disseminate  bda.  However, 
DOD  officials  acknowledge  that  additional  problems  remain  with  improving 
BDA  timeliness  and  accuracy,  developing  nonlethal  bda  functional  damage 
indicators  (particularly  for  new  weapons  that  produce  nontraditional 
effects),  and  cultivating  intelligence  sources  to  identify  and  validate 
strategic  targets.  Moreover,  as  our  analyses  of  the  air  campaign  revealed, 
timely  and  accurate  bda  is  crucial  for  the  efficient  employment  of 
high-cost  guided  munitions  (that  is,  for  avoiding  unnecessary  restrikes). 
Therefore,  acquisition  plans  for  guided  munitions  must  take  fully  into 
account  actual  bda  collection  and  dissemination  capabilities  before  a  final 
determination  can  be  made  on  how  much  to  acquire. 

Third,  dod  officials  told  us  that  survivability  is  now  being  emphasized  in 
pilot  training,  service  and  joint  doctrine,  and  weapon  system  development. 
Pilot  training  was  modified  immediately  after  the  air  campaign  to  meet 
challenges  such  as  medium-altitude  deliveries  in  a  high  antiaircraft 
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artillery  and  infrared  surface-to-air  missile  threat  envirorunent.  Service  and 
joint  doctrine  now  reflect  the  lessons  learned  from  Desert  Storm’s 
asymmetrical  conflict.  Several  fighter  aircraft  employment  manuals 
specifically  incorporate  the  tactics  that  emphasized  survivability  in  the 
campaign,  dod  and  service  procurement  plans  include  new  munitions  with 
global  positioning  system  guidance  systems,  justified  in  part  by  their 
abUities  to  minimize  the  medium-altitude  shortcomings  and  adverse 
weather  limitations  of  Desert  Storm  while  maximizing  pilot  and  aircraft 
survivability- 

Fourth,  DOD  officials  told  us  that  although  Desert  Storm’s  successful 
aircraft  mix  will  not  be  available  for  the  next  contingency,  dod  and  the 
services  have  made  plans  to  maintain  an  inventory  of  aircraft  that  they 
believe  will  be  more  flexible  and  effective  in  the  future.  Flexibility  will  be 
anticipated  partly  from  the  modernization  of  existing  multirole  fighters  to 
enable  them  to  deliver  guided  munitions  (the  aircraft  systems  being  retired 
are  single-role  platforms),  and  their  effectiveness  is  expected  to  increase 
as  new  and  more  accurate  guided  munitions  are  put  in  the  field.  However, 
we  believe  that  strike  aircraft  modernization  and  munition  procurement 
plans  that  include  increasing  the  number  and  variety  of  guided  munitions 
and  the  number  of  platforms  capable  of  delivering  them  require  additional 
justification.^^ 


Recommendations 


Desert  Storm  established  a  paradigm  for  asymmetrical  post-cold  war 
conflicts.  The  coahtion  possessed  quantitative  and  qualitative  superiority 
in  aircraft,  munitions,  intelligence,  personnel,  support,  and  doctrine.  It 
dictated  when  the  conflict  should  start,  where  operations  should  be 
conducted,  when  the  conflict  should  end,  and  how  terms  of  the  peace 
should  read.  This  paradigm — conflict  where  the  relative  technological 
advantages  for  the  U.S.  forces  are  high  and  the  acceptable  level  of  risk  or 
attrition  for  the  U.S.  forces  is  low — ^underlies  the  service  modernization 
plans  for  strike  aircraft  and  munitions.  Actions  on  the  following 
recommendations  wfil  help  ensure  that  high-cost  munitions  can  be 


Desert  Storm,  229  U.S.  aircraft  were  capable  of  delivering  laser-guided  munitiv>ns;  in  1996,  the 
expanded  installation  of  low-altitude  navigation  and  targeting  infrared  for  night  (LANTIRN)  pods  on 
F-lSEs  and  block  40  F-16s  will  increase  this  capability  within  the  Air  Force  to  approximately  600 
platforms.  The  services  have  bought  or  are  investing  over  $58  billion  (then-year  dollars)  to  acquire  33 
different  types  of  guided  munitions  totaling  over  300,000  units.  (See  U.S.  General  Accounting  Office, 
Weapons  Acquisition:  Precision  Guided  Munitions  in  Inventory,  Production,  and  Development, 
GAO/NSIAD-95-95  (Washington,  D.C.:  June  1995).)  Air  Force  plans  reveal  that  nearly  62  perc^t  of  all 
interdiction  target  types  in  a  m^or  regional  conflict  in  Iraq  could  be  tasked  to  either  guided  or 
unguided  munitions  today  (1995)  but  that  will  fall  to  approximately  40  percent  in  2002.  Concurrently, 
the  percentage  of  targets  to  be  tasked  to  only  guided  munitions  will  increase  from  19  percent  in  1995 
to  nearly  43  percent  in  2002. 
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employed  more  efficiently  at  lower  risk  to  pilots  and  aircraft  and  that  the 
future  mix  of  guided  and  unguided  munitions  is  appropriate  and 
cost-effective  given  the  thi  eats,  exigencies,  and  objectives  of  potential 
contingencies. 

Specifically, 

•  In  light  of  the  shortcomings  of  the  sensors  in  Desert  Storm,  we 
recommend  that  the  Secretary  of  Defense  analyze  and  identify  dod’s  need 
to  enhance  the  capabilities  of  existing  and  planned  sensors  to  effectively 
locate,  discriminate,  and  acquire  targets  in  varying  weather  conditions  and 
at  different  altitudes.  Furthermore,  the  Secretary  should  ensure  that  any 
new  sensors  or  enhancements  of  existing  ones  are  tested  under  fully 
realistic  operational  conditions  that  are  at  least  as  stressful  as  the 
conditions  that  impeded  capabilities  in  Desert  Storm. 

•  In  light  of  the  shortcomings  in  bda  exhibited  during  Desert  Storm  and 
boa’s  importance  to  strike  planning,  the  bda  problems  that  DOD  officials 
acknowledge  continue  today  despite  ooo  postwar  initiatives  need  to  be 
addressed.  These  problems  include  timeliness,  accuracy,  capacity, 
assessment  of  functional  damage,  and  cultivating  intelligence  sources  to 
identify  and  validate  strategic  targets.  We  recommend  that  the  Secretary  of 
Defense  ejqjand  dod’s  current  efforts  to  include  such  activities  so  that  bda 
problems  can  be  fully  resolved. 

•  In  light  of  the  quantities  and  mix  of  guided  and  unguided  munitions  that 
proved  successful  in  Desert  Storm,  the  services’  increasing  reliance  on 
guided  munitions  to  conduct  asymmetrical  warfare  may  not  be 
appropriate.  The  Secretary  should  reconsider  dod’s  proposed  mix  of 
guided  and  unguided  munitions.  A  reevaluation  is  warranted  based  on 
Desert  Storm  experiences  that  demonstrated  limitations  in  the 
effectiveness  of  guided  munitions;  survivability  concerns  for  aircraft 
delivering  these  munitions;  and  circumstances  where  less  complex,  less 
constrained  unguided  munitions  proved  equally  or  more  effective. 


A26nCV  CommBritS  Department  of  Defense  partially  concurred  with  each  of  our  three 

recommendations.  In  their  response  to  a  draft  of  our  report,  dod  did  not 
dispute  our  conclusions;  rather,  they  reported  that  several  initiatives  were 
underway  that  will  rectify  the  shortcomings  and  limitations  demonstrated 
hi  Desert  Storm.  Specifically,  they  cited  (1)  the  acquisition  of  improved 
and  new  precision-guided  munitions,  (2)  two  studies  in  process — Deep 
AttackAVeapons  Mix  Study  (dawms)  and  Precision  Strike  Architecture 
study,  and  (3)  several  proposed  fiscal  year  1997  Advanced  Concept 
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Technology  Demonstrations  (actds)  as  programs  capable  of  correcting 
Desert  Storm  shortcomings.  In  addition,  DOD  emphasized  the  importance 
of  providing  funds  to  retain  the  operational  test  and  evaluation  function  to 
ensure  the  rigorous  testing  of  our  weapons  and  weapon  systems.  (See 
appendix  V  for  the  full  text  of  dod’s  comments.) 

We  agree  that  the  actions  cited  by  DOD  address  the  shortcomings  in 
sensors,  guided  munitions,  and  battle  damz^e  assessment  we  report  here. 
However,  the  degree  to  which  these  initiatives  are  effective  can  be 
determined  only  after  rigorous  operational  test  and  evaluation  of  both  new 
and  existing  munitions  and  after  the  recommendations  resulting  from  the 
Deep  AttackAVeapons  Mix  and  Precision  Strike  Architecture  studies  have 
been  implemented  and  evaluated.  Moreover,  we  concur  with  the 
continuing  need  for  operational  test  and  evaluation  and  underscore  the 
role  of  this  function  in  rectifying  the  shortcomings  cited  in  this  report. 

DOD  also  provided  us  with  a  list  of  recommended  technical  corrections. 
Where  appropriate,  we  have  addressed  these  comments  in  our  report. 

As  agreed  with  your  offices,  unless  you  publicly  announce  its  contents 
earlier,  we  plan  no  further  distribution  of  this  report  until  7  days  after  its 
date  of  issue.  We  will  then  send  copies  to  other  congressional  committees 
and  the  Secretary  of  Defense.  We  will  also  make  copies  available  to  others 
upon  request. 

If  you  have  any  questions  or  would  like  additional  information,  please  do 
not  hesitate  to  call  me  at  (202)  512-3092.  Mqjor  contributors  to  this  report 
are  listed  in  appendix  VI. 


Kwai-Cheung  Chan 
Director  of  Program  Evaluation 
in  Physical  Systems  Areas 
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Twelve  Strategic  Target  Categories  in  the 
Desert  Storm  Air  Campaign 


Abbreviation 

Target  category 

C3 

Command,  control,  and  communication  facilities 

ELE 

Electrical  facilities 

GOB 

Ground  order  of  battle  (Iraqi  ground  forces  in  the  Kuwait 
theater  of  operations,  including  the  Republican  Guard) 

GVC 

Government  centers 

LOG 

Lines  of  communication 

MIB 

Military  industrial  base  facilities 

NAV 

Naval  facilities 

NBC 

Nuclear,  biological,  and  chemical  facilities 

OCA 

Offensive  counterair  installations 

OIL 

Oil  refining,  storage,  and  distribution  facilities 

SAM 

Surface-to-air  missile  installations 

SCO 

Scud  missile  facilities 
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Organizations  We  Contacted 


Organization 

Location 

Air  Combat  Command 

Langley  Air  Force  Base,  Va. 

Center  for  Air  Force  History 

Washington,  D.C. 

Center  for  Naval  Analyses 

Alexandria,  Va. 

Central  Intelligence  Agency 

Langley,  Va. 

Defense  Intelligence  Agency 

Washington,  D.C. 

Department  of  Air  Force,  Headquarters 

Washington,  D.C. 

Embassy  of  the  United  Kingdom 

Washington,  D.C. 

Foreign  Science  and  Technology  Center 

Charlottesville,  Va. 

Grumman  Corporation 

Bethpage,  N.Y. 

Gulf  War  Air  Power  Survey  (research  site) 

Arlington,  Va. 

Institute  for  Defense  Analyses 

Alexandria,  Va. 

Lockheed  Advanced  Development 
Corporation 

Burbank,  Calif. 

McDonnell  Douglas  Corporation 

St.  Louis,  Mo. 

Naval  A-6E  Unit 

Oceana  Naval  Air  Station,  Va. 

Navai  F/A-18  Unit 

Cecil  Naval  Air  Station,  Fia. 

Navy  Operational  Intelligence  Center,  Strike 
Projection  Evaluation  and  Anti-Air  Research 
(SPEAR)  Department 

Suitland,  Md. 

Office  of  the  Chief  of  Naval  Operations 

Washington,  D.C. 

Office  of  the  Secretary  of  Defense 

Washington,  D.C. 

Rand  Corporation 

Santa  Monica,  Calif. 

Securities  and  Exchange  Commission 

Washington,  D.C. 

SurvivabilityA^ulnerability  Information 
Analysis  Center 

Wright-Patterson  Air  Force  Base,  Ohio 

Texas  Instruments 

Dallas,  Tex. 

U.N.  Information  Center 

Washington,  D.C, 

U.S.  Atlantic  Fleet,  Headquarters 

Norfolk,  Va, 

U.S.  Central  Air  Forces,  Headquarters 

Shaw  Air  Force  Base,  N.C. 

U.S.  Central  Command,  Headquarters 

MacDiii  Air  Force  Base,  Fia. 

U.S.  Space  Command 

Cheyenne  Mountain  Air  Force  Base,  Colo. 

4th  Tactical  Fighter  Wing 

Seymour  Johnson  Air  Force  Base,  N.C. 

48th  Tactical  Fighter  Wing 

RAF  Lakenheath,  U.K. 

49th  Fighter  Wing 

Holloman  Air  Force  Base,  N.Mex, 

57th  Test  Group 

Nellis  Air  Force  Base,  Nev. 

363rd  Fighter  Wing 

Shaw  Air  Force  Base,  S.C. 

926th  Fighter  Wing  (reserve) 

New  Orleans  Naval  Air  Station,  La. 
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List  of  Consultants 


Our  draft  report  was  reviewed  by  the  following  consultants.  The  final 
report  incorporates  appropriate  changes  based  on  their  questions, 
comments,  and  suggestions. 

Dr.  John  Aheame,  Sigma  Xi,  The  Scientific  Research  Society 

Dr.  EUot  Cohen,  Paul  H.  Nitze  School  of  Advanced  International  Studies  of 
the  Johns  Hopkins  University 

Vice  Adm.  Robert  Dunn,  U.S.  Navy  (ret.),  independent  consultant 
Dr.  Grant  Hammond,  Air  War  College 

Brig.  Gen.  Edwin  Simmons,  U.S.  Marine  Corps  (ret),  U.S.  Marine  Corps 
History  and  Museums 

Col.  Clinton  Williams,  U.S.  Army  (ret),  independent  consultant 
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Comments  From  the  Department  of  Defense 


Note:  GAO  comments 
supplementing  those  in  the 
report  text  appear  at  the 
end  of  this  appendix. 


OFFICE  OF  THE  ASSISTANT  SECRETARY  OF  DEFENSE 

2900  DEFENSE  PENTAGON 
.  WASHINGTON.  D,C.  20301-2900 


STRATEGY 

AND 

REQUIREMENTS 


MAR  2  8  rSSS 


In  Rraly  Refer  to: 
1-96/35381 


Mr.  Kwai-Chcung  Chan 
Director,  Program  Evaluation 
in  Physical  Systems  Area 
Program  Evaluation  and 


U.S.  General  Accounting  Office 
Washington,  DC  20548 


See  comment  1. 


See  comment  2. 


See  comment  3. 


See  comment  4. 


DearMr.Chan: 

This  is  the  Department  of  Defense  (DoD)  response  to  tiic  General  Accoi^g 
(GAO)  draft  report  "OPERATION  DESERT  STORM:  The  Air  Campaign,  Feteu^  12, 1996 
(GAO  Code  97^).  OSD  Case  1094-X.  Th^  Department  naTtiallv  concun  With  the  ICPQIL 

The  DoD  continues  to  believe  the  coalitkm  victory  was  impressive  militarily  and  *‘our  air 
strikes  were  the  most  effective,  yet  humane,  in  the  history  of  warfare.”  (tesidemjjeorge 
Bush.  May  29, 1991).  Similarty  the  DOD  acknowledges  (Title  V  Rept)  the  shortenings  of 

PGMs.  PGM  capabte  aircraft,  TLAM  and  TLAM  strike-planning,  and  our  combat  strike 

assessment  capabiUties.  The  DoD  is  well  along  in  its  programs  to  correct  these  shortcommgs: 

•  The  acquisition  of  improved  and  new  PGMs  (e.g.,  AGM-130,  CALCM,  TLAM,  SIAM 
ER.  XDAM,  and  JSOW)  is  on  track. 

•  Under  ASD(S&R)/D,S&ST/D,PA&E/J-8  co-sponsorship,  the  DoD  has  i^rtakcn  the 
Deep  Attack/Weapons  Mix  Study  (DAWMS)  which  will  give  insight  amwers  mto  the 
proper  mix  of  munitions,  and  insist  into  die  value  to  force  structure  of  adding  different 
platforms  (fighters,  bewnbers,  naval  aviation). 

•  The  Precision  Strike  Architecture  study  and  several  of  the  proposed  FY  1^7  ACTDs 
(Counter  CC&D,  Integrated  Sensor  Tasking,  Operator/  IntclHgericc,  Pn^ion 

Identification/Engagciitent,RapkiBattfefield  Visualization.  Survivable  Armed  .  . 

Reconnaissance  on  tiic  Digital  Battlefield,  and  Unattended  Ground  Sensor)  vwU  give  insight 
into  improvements  to  the  DoD’s  ability  to  locate  targets,  discriminate  among  diem  m 
weather  and  environmental  conctitions,  assess  damage  done  by  pnor  a^ks  the  need 
for  re-attack,  and  rapidly  provide  targeting-quabty  data  to  wc^ions/delivcry  platforms. 

The  DoD  shares  the  GAO  and  Congressional  interest  in  die  effectiveness  of  the  nation's 
aircraft  and  munitions.  The  aforementioned  programs  and  the  FY1996  authOTizanons  Md 
appropriations,  providing  funds  to  retain  the  (>pCTational  Test  &  Evaluation  function  at  the 
OSD-level,  will  ensure  rigorous  testing  of  our  weapons  and  wcqxm  systems. 
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Technical  corrections  lo  the  leport  were  provided  separately.  The  Etepartment 
appreciates  the  opportunity  to  ccnnment  on  the  draft  report 


Frederick  1/  Fiostic 
Deputy  Assistant  Secretary  of  Defense 
Requirements  axxl  Plans 


2 
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Comments  From  the  Department  of  Defense 


GAO  DRAFT  REPORT  -  DATED  FEBRUARY  12,  1996 
(GAO  CODE  973364)  OSD  CASE  1094-X 

“OPERATION  DESERT  STORM:  THE  AIR  CAMPAIGN” 

DEPARTMENT  OF  DEFENSE  COMMENTS 


RECOMMENDATION 


See  comment  5. 


See  comment  3. 


See  comment  2. 
See  comment  6. 


See  comment  7. 


RECOMMENDATION:  In  light  of  the  shortcomings  of  the  scMors  m  Desert  Stonn,  we 

recommend  that  *e  Secretary  of  Defense  analyze  and  identify  DODs  ne^  to  enh^tte 

capabilities  (rf  existing  and  irtanned  sensors  to  effectively  locale,  discnnuittle,  andacqmretai^ 

Varying  weather  condidons  and  at  different  altitudes.  FurthOTKW.  the 
diat  aiy  4w  sensors  or  enhancemenis  of  existing  ones  m  tested  ui^ 

conditions  that  are  at  least  as  stressfiil  as  the  conditions  that  impeded  capabilities  m  Desert  Storm. 

DOD  RESPONSE:  PARTIALLY  CONCUR.  .  •  •  •  j 

The  DoD  is  actively  researching  new  or  enhanced  target  search,  ^insinon,  Md 
(tiscriminatioa  sensors.  The  physical  limitations  of  all  sensors  incli^  La^  ^ 

known  prwr  to  Desert  Storm.  The  DoD  continues  to  seek  new  and  improved  tc^hnolo^ 

ovenxnnc  these  limitations.  Testing  wiU  continue  over  the  entire  range  oi opcratKmal  conditions,  to 

ensure  that  we  understand  the  limitations  of  all  current  and  fu^  system^  Ar^mc 

The  Precision  Strike  Architecture  study  and  several  of  the  proposed  FY97  ACTus 

(Counter  COSa^,  Integrated  Sensor  Tasking,  Operator/ Interngcnc^  PrmsiOT 

Identification/Engagement,  Rapid  Battlefield  Visualization,  Survivable  Aped  I^onnaiss^c  mi 
Ac  Digital  Battlefield,  and  Unattended  Ground  Sensor)  will  give  insight  into  solutions  to  the 
DOoTability  to  locate  targets,  discriminate  among  them  in  varying  weaito  and  cnvmmracnm 
conditions,  assess  damage  done  by  prior  attacks  and  the  need  for  re-attack,  and  rapidly  provide 
targeting-quality  data  to  weapons/delivery  platforms. 

RECOMMENDATION:  In  light  of  the  shortcomings  in  BD A  exhibited  d^g  ^sert  Storm 
and  BDA's  importance  to  strike  planning,  Ac  BDA  problems  that  DoD  officials  acknowledge 
continue  today  despite  DoD  postwar  initiatives,  problems  such  as  timeliness,  ^m^y,  edacity, 
assessment  of  functional  damage,  and  cultivating  intemgcncc  so^  to  icten^  and  validate 
strategic  targets,  need  to  be  dealt  wiA.  We  recommend  Aat  Ac  Secret^  of  Dcfcnre  expand  DoD  s 
current  efforts  to  include  such  activities  so  that  BDA  problems  can  be  fully  rcsolvco. 

DOD  RESPONSE;  PARTIALLY  CONCUR.  .  a- 

Under  ASD(S&R)/D3&ST/D/PA&E/I-8  co-sponsorship,  Ae  DoD  has  undertaken  Ac 
Deep  Attack/Wc^ns  Mix  Study  (DAWMS).  This  study  mvolvcs  an  end-to-end  analysis^ 
ptoi^s  insight  and  answers  on  the  proper  mix  of  munitions;  the  value  to 
diffeaent  platforms  (filters,  bombers,  naval  aviation)  and  mumtions;  and  tfte  C4KR  arcm^^ 
necessary  to  unirpin  our  future  attack  operations.  The  scope  of  this  study  is  sufficient  to  fully 

address  all  facets  (tf  combat  strike  damage  assessment  .  ^  a 

The  BDA  problems  will  never  be  fully  resolved.  M  Ipg  as  hostilities  exist  perfp  BDA 
will  not  exist  Current  investments  m  platfcKm  and  muration  improvements  pipw^qmsio^ 
reflect  lessons  learned  from  DESERT  STORM  and  shortcomings  addressed  m  the  Title  V  report 
and  tiiis  and  previous  GAO  reports. 
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See  comment  2. 


See  comment  8. 


RECOMMENDATION:  In  light  of  the  quantities  and  mix  of  guided  and  unguided  munitions 
that  proved  successful  in  Desert  Storm,  the  Services*  increasing  reliance  on  guid^  munitions  to 
conduct  asymmetri^  warfare  may  not  be  i^yiopriate.  Die  Scaetaiy  should  lecoosider  DoD*  s 
pitted  mix  of  guided  and  unguided  munitions.  A  leevaluadon  is  warranted  based  on  Desert 
Storm  exigences  that  demonstrated  linutatitxis  to  the  effectiveness  of  guided  munitions, 
survivability  concerns  of  aircraft  delivering  these  munitions,  and  circumstances  where  less 
ocmiplex  less  constrained  unguided  munitions  proved  equally  or  more  effective 
DOD  RESPONSE:  PARTIALLY  CONCUR: 

The  Department  is  cunendy  conducting  a  comprehensive  review  of  weapons  and  platforms 

perftHm  assigned  missions.  The  D^  Attack  Weapems  Mix  Study  pAWMS)  under 
ASD(S&R)P,S  AST/p/PA&B/J-8  co-sponsorship  has  undnt^n  a  study  of  the  Dc^’s  aixoiaft 
and  weajwns  mix.  This  study’s  end-to-end  analysis  will  provide  insights  and  answers  on  the 
proper  mix  of  munitions;  the  value  to  force  structure  of  adding  different  platforms  (fighters, 
tombers,  naval  aviation)  and  munitions;  and  die  C4ISR  architecture  necessary  to  underpin  our 
future  attack  concepts  of  operadons. 

Concuirendy,  die  DoD  is  aware  of  the  capabilities  rfour  hi^y-trained  pilots  and  smart 
aircraft  to  achieve  effectiveness  similar  to  smart  and  expensive  weapons.  Innovations  in  tactics  and 
wc^xms  Mng  are  allowing  our  aircraft  ^y  to  use  unguided  munitions  where  guided  munitions 
were  previously  required.  Unguided  mumtitms  will  always  be  an  important  part  of  our  munitions 
inventory  mix.  The  DoD  will  continue  to  evaluate  and  balance  new,  more  accurate,  and  more 
survivablc  weapons  for  those  targets  where  they  are  required. 
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The  following  are  gao’s  comments  on  the  March  28, 1996,  letter  from  the 
Department  of  Defense. 


1.  The  acquisition  of  new  precision-guided  munitions  may  well  provide 

GAO  OOimrieiltS  capabilities  that  overcome  the  limitations  observed  in  Operation 

Desert  Storm.  However,  the  degree  to  which  these  new  munitions  may 
overcome  the  limitations  of  existing  munitions  can  only  be  determined 
after  rigorous  operational  test  and  evaluation  of  both  new  and  existing 
munitions. 

2.  The  Deep  Attack/Weapons  Mix  Study  will  not  fuUy  address  the 
implications  of  our  findings  concerning  the  strengths  and  limitations  of 
guided  and  unguided  munitions,  dawms  is  an  analysis  of  the  full  range  of 
precision-guided  munitions  in  production  and  in  research,  development, 
test,  and  evaluation  that  will  determine  the  number  and  types  of 
precision-guided  munitions  that  are  needed  to  provide  a  complementary 
capability  against  each  target  class.  By  analyzing  only  precision-guided 
munitions,  the  study  does  not  address  the  benefits  realized  from 

92  percent  of  the  munitions  delivered  in  Operation  Desert  Storm.  The 
premise  of  the  dawms  does  not  acknowledge  the  ambiguous  results  from 
Desert  Storm  regarding  munitions  effectiveness,  the  cost  and  operational 
trade-offs  between  guided  and  unguided  munitions,  and  the  demonstrated 
preference  for  unguided  over  guided  munitions  against  several  strategic 
target  categories. 

3.  The  Precision  Strike  Architecture  study  was  designed  to  define  a 
“system  of  systems”  for  precision  strike  by 

•  defining  the  mission, 

•  identifying  the  component  systems, 

•  developing  a  concept  of  operations, 

•  facilitating  opportunities  for  system  evolution, 

.  creating  criteria  for  estabUshing  choices  among  alternatives,  and 

•  determining  costs. 

The  resulting  architecture  for  precision  strike  is  apian  that  addresses  the 
limitations  in  strike  c£^)abilities  demonstrated  in  our  report.  However,  the 
degree  to  which  the  sensor  and  other  precision  strike  shortcomings  me 
alleviated  cannot  be  known  until  a  new  precision  strike  architecture  is 
implemented  and  tested. 
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4.  We  strongly  acknowledge  the  need  to  maintain  a  rigorous  operational 
test  and  evaluation  capability  to  ensure  that  commanders,  planners,  and 
operators  are  aware  of  both  the  strengths  and  weaknesses  of  existing  and 
new  weapon  systems  under  a  variety  of  combat  conditions. 

6.  While  the  physical  limitations  of  all  sensors,  including  laser  and 
forward-looking  infrared,  may  have  been  known  before  Desert  Storm,  they 
were  not  necessarily  fiiUy  acknowledged  by  dod  or  its  contractors  either 
before  the  conflict  or  in  reports  to  Congress  after  the  coalition’s  victory. 

6.  Our  recommendation  addresses  the  demonstrated  intelligence 
shortcomings  in  performing  bda  and  in  identifying  strategic  targets  in 
Operation  Desert  Storm.  It  is  not  apparent  that  the  scope  of  the  Deep 
AttackAVe^ons  Mix  Study  is  sufficient  to  address  dod’s  need  to  cultivate 
intelligence  sources  that  can  identify  and  vahdate  strategic  targets  in 
future  scenarios. 

7.  Part  of  the  sigmficance  of  the  munitions  use  data  from  Desert  Storm  is 
that  it  reveals  patterns  of  use  when  perfect  bda  does  not  exist.  For 
example,  we  found  in  Desert  Storm  that  multiple  strikes  and  weapon 
systems  were  used  against  the  same  targets;  more  munitions  were 
delivered  than  peacetime  test  capabilities  would  indicate  as  necessary; 
determinations  of  whether  target  objectives  were  met  were  frequently 
unknown;  and  when  objectives  were  met,  the  specific  system  responsible 
could  not  be  determined.  These  observations  should  temper  one  of  the 
primaiy  expectations  of  the  dawms:  that  a  growing  inventory  and 
increasing  capabilities  of  weapons  will  reduce  the  sorties  required  for 
deep  attack  missions. 

8.  We  recognize  that  where  dod  concurs  with  the  premises  of  our 
recommendations,  it  does  so  based  on  information  other  than  the  analyses 
we  conducted  of  the  Desert  Storm  air  campaign.  Owing  to  these 
differences,  the  solutions  pursued  by  dod  may  not  fully  address  the  needs 
perceived  by  gao.  Therefore,  although  the  scope  of  the  specific  studies  and 
ACTDs  indisputably  address  our  recommendations,  the  degree  to  which 
they  result  in  solutions  to  Desert  Storm  shortcomings  and  limitations 
cannot  be  known  until  the  resulting  changes  and  innovations  are 
operational. 
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Major  Contributors  to  This  Report 


Program  Evaluation 
and  Methodology 
Division 


Winslow  T.  Wheeler,  Assistant  Director 
Jonathan  R.  Tumin,  Project  Manager 
Jeffrey  K.  Harris,  Project  Manager 
Carolyn  M.  Copper,  Social  Science  Analyst 
Venkareddy  Chennareddy,  Referencer 


(973443) 
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